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Abstract 



An image sensing apparatus includes: a signal processing circuit for processing image sensing signals; a 
plurality of adjustment signal generating circuits for generating mutually different signals for automatic 
adjustment by using part of the signals of the signal processing circuit; an interface for inputting the output 
of the plurality of adjustment signal generating circuits and outputting it through a common signal path; and 
a control microprocessor for adjusting a plurality of adjusting sections of the image sensing apparatus by 
using the output of the plurality of adjustment signal generating circuits output through the common signal 
path, wherein adjustment of the plurality of adjusting sections of the image sensing apparatus using the 
output of the plurality of adjustment signal generating circuits is effected with a reduced number of signal 
paths between the plurality of adjustment signal generating circuits and the control microprocessor, thereby 
simplifyingjhe circuit construction of the image sensing apparatus as a whole and improving the reliability 
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@ Image sensing apparatus provided with a plurality of automatic adjustments using common signal 
paths. 

@ An Image sensing apparatus includes : a sig- 
nal processing circuit for processing image 
sensing signals ; a plurality of adjustment signal 
generating circuits for generating mutually dif- 
ferent signals for automatic adjustment by us- 
ing part of the signals of the signal processing 
circuit; an interface for Inputting the output of 
the plurality of adjustment signal generating 
circuits and outputting it through a common 
signal path; and a control microprocessor for 
adjusting a plurality of adjusting sections of the 
image sensing apparatus by using the output of 
the plurality of adjustment signal generating 
circuits output through the common signal 
path, wherein adjustment of the plurality of 
adjusting sections of the image sensing ap- 
paratus using the output of the plurality of 
adjustment signal generating circuits is effec- 
ted with a reduced number of signal paths 
between the plurality of adjustment signal 
generating circuits and the control microp- 
rocessor, thereby simplifying the circuit con- 
struction of the Image sensing apparatus as a 
whole and improving the reliability thereof. 
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BACKGROUND OF THE INVENTION 

Field of th Invention 

The present Invention relates to an image sens- 
ing apparatus and, in particular, to an image sensing . 
apparatus which is suitable for circuit integration 
resulting from the digitization of signal processing 
operations in such an image sensing apparatus. 

Related Background Art 

There have been remar1<able developments in 
the field of image sensing apparatuses, such as video 
cameras. The performance of such apparatuses has 
been improved and enhanced in various ways, for 
example, by equipping them with a number of func- 
tions. Further, a digital signal processing operation 
has recently been introduced into this field. 

In this regard, an image sensing apparatus has 
already been proposed in which an output from an 
image sensing device, such as a two-dimensional 
CCD having minute color separation filters arranged 
over the entire surface thereof, is digitized by means 
of an AD converter, and subjected to a signal proces- 
sing operation by a signal processing circuit using a 
digital processing technique, thereby obtaining televi- 
sion signals. 

Further, integration of such Image sensing 
apparatuses has been considered. 

In the prior-art technique described above, how- 
ever, the circuits for automatically effecting the focus- 
ing, exposure adjustment, white balance adjustment, 
etc. of the image sensing apparatus are controlled 
separately through different signal paths by means of 
a microcomputer, with the result that the construction 
of the image sensing apparatus as a whole is rather 
complicated. Further, in the prior-art technique, the 
number of IC chips used is rather large and, 
moreover, It is hard to integrate these 10 chips. These 
factors have been a barrier to reducing the size of the 
image sensing apparatus as a whole. In such an 
image sensing apparatus, the digital signal proces- 
sing is separately performed in different sections of 
the apparatus. Thus, it has been impossible to realize 
a digital integrated circuit for video cameras which is 
capable of synthetically perfonming signal processing 
operations in a digital video camera. 

SUMMARY OF THE INVENTION 

The present invention has been made with a view 
toward solving the problems mentioned above. It is a 
first object of the pres nt invention to provide an 
imag sensing apparatus in which a plurality of signal 
processing operations In the apparatus are simplified, 
and in which the number of signal paths is substan- 
tially reduc d, thereby simplifying the construction of 



the control syst m and Improving th reliability of the 
imag s nsing apparatus. 

A second obj ct of th present invention is to pro- 
vld an image sensing apparatus in which an adjust- 

5 ment on adjusting sections related to an image 
sensing operation using the output of various adjust- 
ment signal generating means in the image sensing 
apparatus can be perfonmed with substantially simpli- 
fied signal paths between the adjustment signal 

10 generating means and the control means. 

To achieve these objects, there Is disclosed in 
accordance with a prefenred embodiment of the pre- 
sent invention, an image sensing apparatus compris- 
ing: 

15 signal processing means for processing Image 

sensing signals; 

a plurality of adjustment signal generating 
means for generating mutually different signals for 
automatic adjustment by using part of the signals of 
20 the signal processing means; 

interface means for inputting the output of the 
plurality of adjustment signal generating means and 
outputting it through a common signal path; and 

control means for adjusting a plurality of adjust- 
25 ing sections of the image sensing apparatus by using 
the output of the plurality of adjustment signal 
generating means output through the common signal 
path. 

A third object of the present invention is to provide 
30 an image sensing apparatus in which the signal paths 
between the control means and a plurality of signal 
processing blocks for perfonming various signal pro- 
cessing operations of the image sensing apparatus 
and the signal processing operations are simplified, 
35 thereby making it possible to realize a one-chip-type 
control circuit for controlling an image sensing oper- 
ation. 

A fourth object of the present invention is to pro- 
vide an Image sensing apparatus in which it is poss- 

40 ibie to use a semiconductor device of a small 
mounting area having a substantially reduced number 
of output tenninals, thereby Improving the reliability of 
the image sensing apparatus. 

A fifth object of the present invention is to provide 

45 an image sensing apparatus in which adjustment of a 
plurality of adjusting sections of an image sensing 
apparatus by means of the output of the plurality of 
adjustment signal generating circuits can be perfor- 
med with substantially reduced signal paths between 

50 a plurality of adjustment signal generating circuits and 
a control microprocessor, thereby simplifying the cir- 
cuit construction of the Image sensing apparatus as a 
whole and improving the reliability thereof. 

To achi V these obj cts, there Is disclosed In 

55 accordanc with a pref rred embodiment of the pr - 
sent invention, an image s nsing apparatus compris- 
ing the following compon nts which are integrat d on 
a common semiconductor 
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signal processing m ansforproc ssing image 
sensing signals; 

a plurality of adjustment signal generating 
means for generating mutually diff r nt signals for 
automatic adjustment by utilizing part of the signals of 
the signal processing means; and 

Interface means for inputting the output of the 
plurality of adjustment signal generating means and 
outputting It through a common signal path. 

A sixth object of the present invention Is to pro- 
vide an image sensing apparatus in which various 
adjusting circuits of the image sensing apparatus are 
adapted to perform digital signal processing oper- 
ations, and in which the control system for these sig- 
nal processing circuits is simplified, thereby realizing 
a one-chip microprocessor for image sensing 
apparatuses. 

A seventh object of the present Invention Is to pro- 
vide a digital signal processing circuit IC for video 
cameras in which digital signal processing circuit 
blocks for automatic focusing, white balance adjust- 
ment, and automatic Iris adjustment are realized In a 
one-chip structure. 

An eighth object of the present invention is to pro- 
vide a digital signal processing circuit interface for 
video cameras In which interface blocks for outputting 
parameters for perfonming adjustments regarding an 
image sensing operation, such as automatic focusing, 
white balance adjustment and automatic iris adjust- 
ment to a common arithmetic circuit are realized in a 
one-chip structure. 

Other objects and features of the present Inven- 
tion will become apparent from the following embodi- 
ments and drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is diagram showing an embodiment of the 
present Invention; 

Fig. 2 is a detailed diagram illustrating an AF pre- 
processing In the embodiment of Fig. 1; 
Fig. 3 is a diagram illustrating the case where the 
AF frame of Fig. 2 is enlarged; 
Fig. 4 is a diagram illustrating the case where the 
AF frame of Fig. 2 is reduced; 
Fig. 5 is a detailed diagram illustrating an AE pre- 
processing in the embodiment of Fig. 1; 
Fig. 6 is a diagram illustrating a centralized AE 
photometric distribution in Fig. 5; 
Fig. 7 is a diagram Illustrating a counter-light 
measurement frame In Fig. 5; 
Fig. 8 is a detailed view of an AWB pre-process 
in the embodiment of Fig 1 ; 
Fig. 9 Is a diagram illustrating an AWB frame In 
Fig. 8; 

Fig. 10 is a detailed view of an MPU Interfac in 

the embodiment of Fig. 1; 

Fig. 1 1 is a flowchart illustrating the operation of 



an MPU in th embodiment of Fig. 10 when power 
Is turn d on; 

Fig. 12 is a diagram Illustrating the operation 
wh n an Interrupt due to VD has occurred In th 
5 MPU operation flowchart of the embodiment of 

Fig. 10; 

Fig. 13 is a diagram illustrating an operation of AF 
control In step 612 of the operation flowchart of 
Fig. 12; 

10 Fig. 14 is a diagram illustrating an operation of AE 
control in step 613 of the operation flowchart of 
Fig. 12; 

Fig. 15 is an operation diagram illustrating a con- 
tinuation of the operation flowchart of Fig. 14; 

15 Fig. 16 is a diagram illustrating counter-light 
detecting operations In steps 640 to 642 of the 
operation flowcharts of Figs. 14 and 15; 
Fig. 17 Is a diagram Illustrating a frame C for AE 
control in Fig. 12; 

20 Fig. 18 is an operation diagram illustrating an 
AWB control in step 614 of the operation flow- 
chart of Fig. 12; 

Fig. 19 is an operation diagram showing a con- 
tinuation of the operation flowchart of Fig. 18; and 
25 Fig. 20 Is a diagram illustrating an AWB frame In 
Fig 19. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENT 

30 

[First Embodiment] 

Fig. 1 is a block diagram Illustrating an embodi- 
ment of the present invention. 

35 Numeral 1 indicates an image sensing lens; num- 
eral 2 Indicates an automatic focusing (AF) motor for 
rotating a focus ring of the image sensing lens 1 ; num- 
eral 3 indicates a diaphragm; numeral 4 Indicates an 
IG meter for controlling the aperture of the diaphragm 

40 3; and numeral 5 Indicates a two-dimensional color 
Image sensing device including minute color separat- 
ing filters (hereinafter referred to as "CCD"). However, 
the image sensing device of the present Invention is 
not restricted to CCD; it is also possible to employ an 

45 image pickup tube or an X-Y address sensor. Numeral 
6 indicates a CCD driver for driving the CCD 5; num- 
eral 7 indicates a correlative double sampling circuit 
(CDS) for removing clocks and reset noise from the 
photoelectric conversion output of the CCD 5; num- 

50 eral 8 indicates an automatic gain control amplifier 
(AGC) for amplifying the output of the CDS 7 in 
accordance with a control signal AGCC; numeral 9 
indicates a clamp circuit for fixing the black level of an 
input voltag to a fix d voltage; numeral 10 indicates 

55 an Integrated circuit for perfonming signal proc ssIng 
operations on th output signals of the CCD supplied 
thereto to fonm predetemiin d color video signals; 
numeral 12 Indicates a microprocessor unit (MPU) 
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which r ceiv s digital data on th signals supplied 
from the integrated circuit 10, controls th integral d 
circuit 10 and, furth r, generates signals for control- 
ling the AF motor 2. th IG meter 4, and th AGC 8; 
numeral 13 indicates an AF driver circuit for driving 
the AF motor 2; numeral 14 indicates an IG driver cir- 
cuit for driving the IG meter 4; numeral 15 indicates a 
chrominance signal (C) output terminal; and numeral 
16 indicates a luminance signal (Y) output tenminal. 

Numerals 100 to 126 indicate inner circuit compo- 
nents of the integrated circuit 10, of which numeral 
100 indicates a synchronization signal generator 
which generates a blanking pulse BLK, a burst flag 
pulse BF, a color sub-canrier SC, a line sequential sig- 
nal ALT, a composite synchronization signal CSYNC, 
etc. for the generation of standard television signals, 
in response to a clock pulse, a horizontal synchroni- 
zation pulse HD and a vertical synchronization pulse 
VD which are supplied from a timing generation circuit 
11, an NTSC and a PAL switching signal N/P which 
are supplied firom the MPU 12, and clock pulses of dif- 
ferent frequencies needed for the interior of the inte- 
grated circuit 10. 

Numeral 101 indicates an AD converter for 
generating digital signals in accordance with input sig- 
nals. The circuits from this AD converter onward treat 
digital signals. Numeral 102 indicates a color-sepa- 
ration/iuminance signal-synthesis circuit which 
includes two delay lines of one horizontal line, a matrix 
circuit and a switching circuit and which is adapted to 
separate color signal components R, G and B from 
input signals and to synthesize a luminance signal Yc, 
and further, to synthesize luminance signals Y- and 
Y+ which are vertically shifted by one line upwardly 
and downwardly from Yc. Numeral 103 indicates a 
low-pass filter for effecting band restriction and time- 
division sampling; and numeral 104 indicates a white 
balance (WB) circuit for varying the gains of time-di- 
vided color channels. 

Numeral 105 indicates a gamma & Knee circuit 
for perfonming gamma correction and level compres- 
sion of high-luminance components; numeral 106 
indicates a low-pass filter which receives time-divi- 
sion signals to convert them to continuous parallel sig- 
nals of three channels (R, G and B) and which further 
effects band restriction; numeral 107 indicates a mat- 
rix circuit which synthesizes low-band luminance sig- 
nals YL1 and YL2 from R, G and B; numeral 108 
indicates a color difference matrix circuit for generat- 
ing signals R-Y and B-Y from R, B and YL2; numeral 
109 indicates a color correction circuit for performing 
gain control over the color-difference signals and 
including a color correction matrix; numeral 110 indi- 
cates low-pass filter; and numeral 111 indicat s a 
modulation circuit which adds up the color-differenc 
signals after modulating them by a color sub-carrier 
(SC) and which furth r adds a color burst signal. 
Num rals112and121 indicate DA convert rsfor 



converting digital signals to analog signals; numeral 
113 indicat s a gamma-correction circuit for p rfonm- 
ing gamma correction on the thr eluminanc signals 
input; numeral 114 indicates a high-pass filt r which 

5 only passes predetermined high-luminance compo- 
nents of the luminance signals; numeral 1 15 and 1 17 
indicates non-linear processing circuits which com- 
press those input signals which are around the zero 
level; numeral 1 18 indicates a delay line for effecting 

10 delay corresponding to the delay time of the high-pass 
filter 114; numeral 119 indicates an adder; and num- 
eral 120 indicates afaderfor changing the gains of the 
luminance signals and performing blanking proces- 
sing. 

15 Numeral 122 indicates a preprocessing section 

which perfomns processing such that the delivery of 
data to and from the MPU and the processing by the 
MPU are facilitated when the MPU reads those sig- 
nals of the different sections of the integrated circuit 

20 1 0 which are necessary for control operations, such 
as automatic focusing (AF). automatic exposure con- 
trol (AE) and automatic white balance control (AWB). 
The circuits indicated by numerals 123 to 126 are pro- 
vided in the preprocessing section 122. An AF prepro- 

25 cessing circuit 1 23 perfonms preprocessing of AF; an 
AE preprocessing circuit 124 performs preprocessing 
of AE; an AWB preprocessing circuit 125 perfomns 
preprocessing of AWB; and an MPU interface circuit 
1 26 delivers the output of these preprocessing circuits 

30 to the MPU 12, and receives control data on the dif- 
ferent sections of the integrated circuit 10 supplied 
from the MPU 12. 

Next, the operation of the above embodiment will 
be described. An image of a subject (not shown) is 

35 adjusted in terms of quantity of light by the image 
sensing lens 1 and diaphragm 3. and is transmitted 
through the above-mentioned minute color separation 
filters of the CCD 5 to undergo color separation. Then, 
the image is formed on the photoelectric conversion 

40 surface of the CCD to undergo photoelectric conver- 
sion pixel by pixel, and output sequentially as image 
sensing signals in response to the driving pulses of 
the driver circuit 6. First, the clock components and 
reset noise are removed from these image sensing 

45 signals by the CDS circuit 7, and the signals are 
amplified by the AGC circuit 8 in accordance with the 
gains corresponding to the AGCC signals. The black 
level is fixed to a reference voltage which is substan- 
tially at the lower limit of the input range of the ADC 

50 circuit 101, and the signals are converted to digital 
signals by the AD converter 101 in the integrated cir- 
cuit 10. 

These digital signals are first separated into color 
compon ntsof R.Gand Bbyth colors parationA"- 
55 synthesis circuit 102. Atth same time, the luminance 
signal YC is synthesized along with the luminance sig- 
nal Y-, which is on horizontal line abov (b fore) this 
luminanc signal, and the luminanc signal Y+, which 
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is one horizontal line below (after) this luminance sig- 
nal. Thes R, G and B signals are restrict d to a fixed 
band by the low-pass filter 103, and th n thre -pha- 
se-convert d to time-division signals to become on - 
channel signals. In the WB circuit 104, these signals 
are amplified In accordance with fixed gains set by the 
MPU 12. In this process, white balance adjustment is 
effected by changing only the gains of the R and B sig- 
nals, and, by simultaneously varying the gains of the 
R, G and B signals, an overall gain control can be 
effected. 

This output Is subjected to gamma confection and 
high-luminance-component compression by the 
gamma & Knee circuit 105, and is restored to the R, 
G and B signals by the low-pass filter 106. After being 
restricted to a fixed band, the R, G and B color signals 
are added up at a fixed ratio by the matrix circuit 107 
to fomri low-pass luminance signals YL1 and YL2. As 
stated below, YL1 is subjected to re-sampling at the 
same sampling rate as a high-pass luminance signal 
so as tofomfi a high-pass luminance signal. YL2 is not 
subjected to re-sampling since it is only used for the 
fonnation of color difference signals. 

Subtraction is perfomned on the YL2, R and B at 
a fixed ratio by the color difference matrix circuit 108 
to form color difference signals R-Y and B-Y. These 
color difference signals are subjected to gain control, 
predetennrilned matrix computation and color correc- 
tion by the color-correction/fader circuit 109. Further, 
when the MPU 12 designates a fading operation, a 
gradual gain variation is effected. This output is sub- 
jected to re-sampling by the low-pass filter 110 at a 
sampling rate needed for color modulation, for 
example, four times the frequency of the color sub- 
carrier SC. restricted to a fixed band, and modulated 
at the modulation circuit 1 1 1 by the color sub-carrier 
SC, with a burst signal being superimposed in accord- 
ance with a burstflag signal BF. If. at this time, the N/P 
signal designates PAL, the burst signal and chromi- 
nance signal are inverted in a fixed phase in accord- 
ance with the ALT signal so as to be adapted to the 
PAL standard. 

This output is digital-analog converted by the DA 
converter 112 and output from a C-output temninal 1 5 
as a chrominance signal to be supplied to a VTR, tele- 
vision monitor or the like (not shown). 

The luminance signals Yc. Y- and Y+, output from 
the color-separationA'-synthesis circuit 102. are sub- 
jected to gamma correction by the gamma correction 
circuit 113 to form, first, high-pass luminance signals 
YH1 and YH2 by means of the high-pass filter 114. 
Here, it is assumed that the signal YH1 is beyond the 
band of the low-pass luminance signal YL1 for 
generating the above-mention d luminanc signal, 
and that th range of th signal YH2 is 3 to 4MHz or 
more, etc. 

The signal YH2 is converted by the non-lin ar 
processing circuit 115 to a horizontal contour 



emphasis signal EH which has undergone compres- 
sion around the zero level. Th output of the gamma 
correction circuit 1 1 3 is subject d to addition and sub- 
traction by the adder 1 16 and is likewis subjected to 

5 compression around the zero level by the non-linear 
processing circuit 117, and delayed by the delay cir- 
cuit 1 1 8 to become a vertical contour emphasis signal 
EV. The signals YL1, YH1 , EH and EV are added up 
by the adder 1 1 9 to fonm a luminance signal Y, which 

10 is subjected to blanking processing by the fader 120. 
and, as in the above case, a gradual gain variation is 
effected at the time of the fading operation. 

The output signal is digital-analog converted by 
the DA converter 121 and added to the composite 

15 synchronization signal CSYNC by the adder 16. and 
is output from a Y-output tenminal 17 to be supplied, 
as in the above-described case, to a VTR. television 
monitor or the like (not shown). 

The signals Yc, Y- and Y+ are processed by the 

20 AF preprocessing circuit 1 23 to form requisite data for 
AF, and the signal Yc is processed by the AE prepro- 
cessing circuit 124 to fonn requisite data for AE. 
Further, the output signals R-Y and B-Y from the abo- 
verdescribed color difference matrix circuit 108 are 

25 processed by the AWB preprocessing circuit 125 to 
form requisite data for AWB. These items of data are 
read by the MPU circuit 12 through the MPU interface 
circuit 126. 

Fig. 2 shows in detail the AF preprocessing circuit 
30 123 of Fig. 1. Numeral 201 indicates an adder; num- 
erals 202 and 206 indicates absolute value circuits for 
obtaining the absolute values of input signals; numer- 
als 203 and 207 indicate gate circuits for gating input 
signals in accordance with a gate signal SGI ; numer- 

35 als 204 and 208 indicate maximum value hold circuits 
for holding the maximum values of in put signals; num- 
eral 205 indicates a band pass filter; numeral 209 indi- 
cates an AF frame register for retaining the position 
and size of an AF frame on an image plane; numeral 

40 210 indicates a comparator; numeral 21 1 indicates an 
H counter which is reset by a horizontal synchroni- 
zation signal HD to count clocks; numeral 212 indi- 
cates a V counter which is reset by a vertical 
synchronization signal VD to count HD; and numeral 

45 213 indicates an internal bus for connecting the AF 
preprocess circuit 123, the AE preprocess circuit 124 
and the AWB preprocess circuit 125 to the MPU inter- 
face circuit 126. 

First, the H counter 211 and the V counter 212 

50 generate a signal conresponding to the present scan- 
ning position of an image sensing signal in the image 
plane, and the signal is compared by the comparator 
210 with frame data previously written to the AF frame 
register 209 to generate a fram signal SGI repr - 

55 senting the AF frame, I. ., the extraction rang of th 
image s nsing signal for AF. 

A high-frequency-band component ranging, e.g., 
from 1 to 3MHz, which is r quired for AF. is xtract d 
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from the input luminance signal Yc by th band pass 
filter 205, and th absolute value th reof is obtained 
by the absolute value circuit 206 to be gat d by th 
gat circuit 207 in accordanc with th abov -m n- 
tloned gate signal SG1 within the range correspond- 5 
Ing to the above-mentioned AF frame, the maximum 
value hold circuit 208 holding the maximum value EH 
of the high-frequency component in the horizontal 
direction in the above AF frame. 

In this process, an AF reset signal B is generated, io 
for example, during vertical blanking interval, by the 
MPU interface circuit 126. thereby resetting the 
maximum value hold circuit 208. Afterwards, the 
maximum value EH held by the maximum value hold 
circuit 208 is output to the internal bus 213 due the i5 
generation of an AF read signal B at the beginning of 
the next vertical blanking interval. 

Further, in the adder 201, addition and subtrac- 
tion are perfonned on the luminance signals Yc, Y- 
and Y+, to obtain a high-pass component in the verti- 20 
cal direction, which is converted to an absolute value 
by the absolute value circuit 202, and gated by the 
gate circuit 203 in accordance with the above-men- 
tioned gate signal SG1, and the maximum value EV 
of the high-frequency component in the vertical direc- 25 
tion within the AF frame is held by the maximum value 
hold circuit 204. 

As in the case of the maximum value hold circuit 
208, the operations of resetting and reading out to the 
internal bus 21 3 of the data being held are perfomied 30 
in accordance with an AF reset signal A and an AF re- 
ad-out signal A, respectively. 

The maximum values in the horizontal and verti- 
cal directions of the high-frequency component thus 
read out are used in AF control in accordance with the 35 
algorithm shown in Fig. 13. 

Figs. 3 and 4 illustrate the AF frame of Fig. 2. In 
the drawings, the outer frame represents an image 
plane, and the inner frame represents the AF frame. 
When, for example, coordinate values x1 , y1 , x2 and 40 
y2 are written to the AF register 209 in the manner 
shown in Fig. 3, the AF frame obtained is relatively 
large with respect to the image plane, and when coor- 
dinate values x3, y3, x4 and y4 are written in the man- 
ner shown in Fig. 4, the AF frame obtained is relatively 45 
small with respect to the Image plane. Switching be- 
tween the two manners of writing is effected by a 
switch SW1 of Fig. 10 described below. The pattern 
of the AF frame is not restricted to that of this embo- 
diment. Further, it is also possible for a plurality of AF so 
frames to exist simultaneously. 

Fig. 5 shows in detail the AE preprocess circuit 
124 of Fig. 1. Numeral 301 indicates a gate circuit for 
s ttinganAEframeinth image plan ;num rals302, 
304 and 305 indicate integrators; numeral 303 indi- 55 
cates a switching circuit; numeral 306 indicates a C- 
frame register; numeral 307 indicates a comparator; 
numeral 308 indicates an H count r which is reset by 



HD and adapted to count clocks; num rai 309 indi- 
cates V counter which Is res t by VD and adapt d to 
count clocks; and numeral 310 indicates ad coder for 
gen rating a pr det rmin d frame signal. 

First, a signal conresponding to the scanning posi- 
tion of the image sensing signal in the image plane is 
generated by the H counter 308 and the V counter 
309. and this signal is compared by the comparator 
307 with C-frame data previously written to the C-fra- 
me register from the MPU Interface circuit 126 by an 
AE-frame-C-register writing pulse, thereby generat- 
ing a frame signal SG2. At the same time, the output 
of the H counter 308 and that of the V counter 309 are 
input to the decoder 310 to form a predetermined 
frame signal SG3. 

The input luminance signal Yc is first gated by the 
gate circuit 301 in accordance with the gate signal 
SG2 of a nravable frame, and is integrated by the 
integrator 302. At this time, an AE reset signal C Is 
generated by the MPU interface circuit 126, for 
example, during the vertical blanking interval, thereby 
resetting the integrator 302. When an AE read-out sig- 
nal C is generated by the MPU interface circuit 126 at 
the beginning of the next vertical blanking interval, 
data which has been integrated by the integrator 302 
is output to the internal bus 213. 

Further, the luminance signal Yc is switched by 
the switching circuit 303 in accordance with the gate 
signal SG3 of a predetermined frame, and is inte- 
grated by the integrator 304 or 305. 

At this time, as in the above-described case, the 
resetting of the Integrators 304 and 305 and data out- 
put are effected in accordance with the AE reset sig- 
nals A and B and the AE read-out signals A and B. 

Figs. 6 and 7 are diagrams Illustrating the oper- 
ation of the circuit shown in Fig. 5. In the drawings, the 
outer frame represents the image plane. In Fig. 6. the 
portion on the outside of the frame represented by 
predetermined coordinate values (XI. Y1) and (X2, 
Y2) is refen'ed to as area A, and the portion on the 
inside of the same is referred to as area B, the lumi- 
nance signals In these areas being respectively input 
to the integrators 304 and 305 shown In Fig. 5. When 
coordinate values (x5. y5) and (x6, y6) are written to 
the C-frame register 306, a C-frame as shown in Fig. 
7 is obtained, and the luminance signal on the inside 
of the frame is input to the integrator 302 shown in Fig. 
5. 

The output of the integrators 302, 304 and 305 
thus read out are used in AE control in accordance 
with the algorithm shown in Figs. 14 to 17 described 
below. The pattern of the AE frame is not restricted to 
the above described; the position, number, combi- 
nation, etc. th r of may b changed as ne ded. 

Fig. 8 shows in d tail the AWB preprocess circuit 
125 of Fig. 1. Numerals 401 and 403 indicate gat cir- 
cuits for s tting an AWB frame; numerals 402 and 404 
indicate integrators; numeral 405 indicate an AWB 
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frame register numeral 406 indicates a comparator; 
numeral 407 indicat s an H counter which is r set by 
HD and adapt d to count clocks; and numeral 408 
indicates a V counter which is res t by VD and adap- 
ted to count MD. 

First, the H counter 407 and the V counter 408 
generate signals corresponding to the scanning posi- 
tion of the image sensing signal in the image plane, 
and these signals are compared by the comparator 
406 with AWB-frame data written to the AWB frame 
register 405 from the MPU interface circuit 126 In 
accordance with AWB-frame-register writing pulses., 
thereby generating a gate signal SG4. 

The input color difference signals R-Y and B-Y 
are first gated by the gate circuits 401 and 403 in 
accordance with the AWB frame gate signal SG4, and 
are integrated by the integrators 402 and 404. During, 
for example, the vertical blanking interval, R-Y reset 
signal and B-Y reset signal are generated by the MPU 
interface circuit 126, and the integrators 402 and 404 
are reset. At the beginning of the next blanking Inter- 
val, R-Y read-out signal and B-Y read-out signal are 
generated, and integrated data Is output to the inter- 
nal bus 213. 

Fig. 9 illustrates the operation of the circuit shown 
in Fig. 8. The outer frame portion represents the 
image plane. When coordinates (x7, y7) and (x8, y8) 
are written to the AWB frame register 405, an AWB 
frame as shown In the drawing is obtained, and the 
color difference signals on the Inside of this frame are 
input to the integrators 402 and 404 of Fig. 8. 

The output of these integrators 402 and 404 is 
used in AWB control in accordance with the algorithm 
shown in Figs. 18 to 20 described below. 

Fig. 10 shows in detail the MPU circuit 12 and the . 
MPU interface circuit 126 of Fig. 1. The components 
indicated by numerals 501 to 509 are provided inside 
the MPU circuit 12. Numeral 501 indicates a CPU cir- 
cuit; numeral 502 indicates a memory for holding pre- 
determined programs and data; numeral 503 
indicates an intemal bus of the MPU circuit; numerals 
504 and 505 Indicate DA converters; numerals 506, 
507 and 508 indicate I/O ports; and numeral 509 indi- 
cates an interruption generating section. Numerals 
510 and 511 indicate switches connected to the I/O 
port 506 of the MPU circuit 12; numerals 512 and 513 
indicate bus buffers adapted to operate in accordance 
with control signals; and numeral 514 indicates a com- 
mand decoder adapted to interpret input commands 
and generate signals for controlling the different sec- 
tions inside the integrated circuit 10. 

In accordance with the program of the memory 
502, the CPU 501 reads the conditions of the switches 
SW1 and SW2 conn cted to the 10 port 506. inputs 
and outputs data and commands to the MPU interfac 
circuit 126 through 10 ports 507 and 508, and gener- 
ates an AF motor control voltage AFMC and an IG 
control voltage IGC through the DA converters 504 



and 505. Further, when th v rtical synchronization 
signal VD is input, the int rruption generating section 
509 g nerates in th CPU 501 an interruption signal, 
whereby the CPU perfonms proc ssing at th time of 
5 interruption. 

The switch SW1 is a switch for setting the size of 
the AF frame. By manipulating this switch, the 
operator can select either of the AF frames having dif- 
ferent sizes shown in Figs. 3 and 4. Further, it is also 
10 possible to employ an arrangement in which still other 
patterns can be selected. The switch SW2 is a switch 
for performing a fading operation. By depressing this 
switch, the operator can effect fade-out or fade-in of 
an image. The command decoder 514 receives a 
15 command from the lO port 507 in accordance with a 
chip select signal CS generated at the 10 port 508, 
and interprets the command. When it is a write com- 
mand, the bus buffer 512 Is operated and, at the same 
time, a corresponding write pulse is generated. When 
20 it is a readout command, the bus buffer 51 3 is oper- 
ated and, at the same time, a corresponding read-out 
pulse Is generated. 

Further, in accordance with a reset command, 
setting commands for different sections, etc., a reset 
25 pulse, an NTSC/PAL switching pulse, a fade signal, 
etc. are generated. 

Figs. 11 to 19 are flowcharts illustrating the oper- 
ation of the MPU circuit 12 shown in Fig. 10. 

Fig. 1 1 shows the operation when power is turned 
30 on. The operation is started in step 601, and, in step 
602, the NTSC/PAL switching is set, and the fixed 
values In the integrated circuit, such as the initial gain 
values, etc. are set through the MPU interface circuit 
1 26. In step 603. the maximum value or integral value 
35 of each of the preprocess circuits for AF. AE and AWB 
is reset, and, in step 604, the initial value of each 
frame register Is set. In step 605. intenruption by the 
vertical synchronization signal VD is pemnitted, and, 
in step 606, the circuit goes into hold state. After- 
40 wards, the operation is performed in accordance with 
the interruption due to VD. 

Fig. 12 shows the operation at the time of VD 
interruption. When, in step 607, VD Interruption Is 
generated, the maximum value and integral value of 
45 each of the preprocess circuits for AF, AE and AWB 
are read, and, in step 609, the value of each of the 
frame registers for AF, AE and AWB is updated. In 
step 61 0. the R and B gain control values are updated 
and, in step 611. the maximum value and integral 
50 value of each of them are reset The operations of 
steps 608 to 61 1 are completed within the vertical 
blanking Interval. In steps 612 to 614, AF control. AE 
control and AWB control are performed and, in step 
615. the circuit goes into hold stat again to await VD 
55 interruption. Th operations of steps 607 to 615 are 
compl t d within one vertical blanking interval (16ms 
to 20ms). 

Fig. 13 illustrates in d tail th AF control In step 
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612 of Fig. 12. First, the control is started in step 616 
and, in step 617. the maximum value EV of the r ad 
high-frequency compon nt in the v rtical direction is 
compar d with the maximum value EH of the high-fr - 
quency component in the horizontal direction. When 
EH is larger than EV, the AF operation is perfonmed 
by using the high-frequency component in the hori- 
zontal direction. For this purpose, EH is substituted for 
the cunrent value of the high-frequency component, 
Enow, in step 618. When, in step 617, EV is larger 
than EH, EV is substituted for Enow so as to use the 
high-frequency component in the vertical direction. 

In step 620, the change in the high-frequency 
component, Ed, Is obtained by subtracting the previ- 
ous high-frequency component Eold from the current 
high-frequency component Enow. Further. Enow is 
substituted for Eold. In step 621 , Ed is compared with 
predetermined threshold values Eth and -Eth. When 
Ed is smaller than -Eth, it is to be assumed that the 
high-frequency component has been reduced, I.e., 
the focus point has moved in the opposite direction, 
due to the rotation of the AF motor, or that the focus 
point has been displaced despite the motor remaining 
still. Accordingly, a judgment is made in step 622 as 
to whether the AF motor control voltage is 0 or not. 
When it is 0, a predetenmined value SAF is substituted 
for AFMC in step 624 so as to turn the AF motor. When 
AFMC is not 0 in step 622, the polarity of AFMC is 
inverted so as to move the focus point in the opposite 
direction. 

When, in step 621, Ed is larger than -Eth and 
smaller than Eth, it is to be assumed that the Image 
sensing apparatus is in focus, so that in step 625, 
AFMC is reduced to 0 to stop the AF motor. When, in 
step 621, Ed is larger than Eth, focus control is in the 
right direction, so that AFMC is left as it is. 

In step 626. the AFMC voltage set in the manner 
described above is output from the DA converter 504 
inside the MPU 12. In step 627, the condition of the 
switch SW1 of Fig. 10 is checked. If the switch is in 
the OFF position, the frame size is set large, as shown 
in Fig. 3, in step 628 and, when the switch is in the ON 
position, the frame size is set small, as shown in Fig. 
4, in step 629. the AF control being temninated in step 
630 to proceed to AE control. 

Fig. 14 is a flowchart illustrating in detail the AE 
control in step 61 3 of Fig. 1 2. The control starts in step 
631, and. in step 632. a weighting average AB of the 
areas A and B in Fig. 6 is obtained. That is, the integral 
value A of the area A obtained as the output of the 
Integrator 304 of Fig. 5 is multiplied by a weight K1, 
and the integral value B of the area B obtained as the 
output of the integrator 305 of Fig. 5 Is multiplied by a 
weight K2. By adding up th two int gral values, a 
weighting average AB is obtained. Furth r, the differ- 
ence between this value and a ref rence value ABr is 
obtained as ABe. 

In St p 633, the value of AB is multiplied by a 



predetermined coefficient K3. and the value thus 
obtain d is subtracted from the current IG driv volt- 
age IGC, thereby obtaining the n xt IG driv voltag 
IGC. 

5 In step 634. the integral signal C read from the 

integrator 302 of Fig. 5 is substituted for data Cij on 
the current position of the C-frame, and, in step 635, 
j is incremented by 1. In step 636, j is compared with 
a predetemriined number of division in the horizontal 
10 direction, n. If j is smaller than or equal to n, the pro- 
cedure advances to step 640; if it is greater than n, j 
is set to 1 in step 637, and i is incremented by 1. 

Further, in step 638, i is compared with a pre- 
determined number of division in the vertical direction, 
15 m. If i is smaller than or equal to m. i is left as it is. and. 
when It is greater than m, i is set to 1 in step 639. Then, 
in step 640, the minimum value of C in the area D of 
Fig 16, CDmin, is obtained, and, in step 641 , the aver- 
age of C in the area E of Fig. 16, CEavg. is obtained. 
20 In step 642 of Fig. 15. the ratio of CDmin to CEavg is 
compared with a predetermined threshold value Cth. 
When it is equal to or greater than Cth, the procedure 
advances to step 644; when it is smaller than Cth, the 
luminance of the background is rather high with res- 
25 pect to the subject, that is, the image sensing 
apparatus is in the so-called backlight state, so that, 
in step 643, a predetenmined exposure correction 
value VBC is subtracted from IGC. 

In step 604 of Fig. 1 1, the frame has been reset 
30 to C11, so that the frame C is sequentially switched 
field by field after power is turned on, with CDmin and 
CEavg changing each time such switching is effected. 

In step 644, IGC is output from the DA converter 
505. In step 645, x5, y5. x6 and y6 are obtained from 
35 the vertical and horizontal frame sizes a and b and the 
horizontal and vertical frame positions j and i so as to 
obtain the next position of the C-frame, and the AE 
control is terminated in step 646. Fig. 17 illustrates an 
AE control operation. In the drawing, the outer frame 
40 represents the image plane, which is divided into n 
sections in the horizontal direction and m sections in 
the vertical direction, the current position of the C-fira- 
me in the image plane being indicated by i and j. The 
AE control operation is terminated in step 646, and the 
45 procedure advances to AWB control. 

Fig. 18 is a detailed flowchart of the AWB control 
step In Fig. 1 2. The AWB control is started in step 647. 
and, in step 648, the read data R-Y and B-Y is substi- 
tuted for the color difference data on the current posi- 
50 tion of the AWB frame. (R - Y)ij and (B - Y)ij. In step 
649, j is incremented by 1 , and, in step 650. j is con> 
pared with the number of division in the horizontal 
direction of the AWB frame, n. When j is smaller than 
or equal to n, it is left as it is. and, if it is larger than n, 
55 j is set to 1 in step 651, and i is increm nted by 1. In 
step 652, 1 is compared with th number of division in 
th vertical direction of the AWB frame, m. Wh n i is 
small r than or qual to m, it is left as it is, and, if it is 
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larger than m. i is set to 1 in st p 653. 

As in the case of the AE fram , the AWB frame is 
resettotheupperl ftcornerofth image piane. After- 
wards, it is shift d field by field. 

In step 654, the weighting total SR-Y of (R - Y)ij 
is obtained, and, in step 655, the weighting total SB-Y 
of (B - Y)ij is obtained. If, In step 656, SR-Y is smaller 
than a predetenmined threshold value -(R - Y)th, a pre- 
determined value RGO is subtracted from the R gain 
control value RGAIN, in step 657. If, in step 656, SR-Y 
is greater than or equal to -(R - Y)th and smaller than 
or equal to (R - Y)th, the value is left as it is, and, if 
SR-Y is greater than (R - Y)th, the predetermined 
value RGO is added to RGAIN in step 658. Likewise, 
if, in step 659 of Fig. 19, SB-Y is smaller than a pre- 
determined threshold value -(B - Y)th, a predeter- 
mined value BGO is subtracted from the B gain control 
value RGAIN, in step 660. 

If. in step 659, SB-Y is greater than or equal to -(B 
- Y)th and smaller than or equal to (B - Y)th, the value 
is left as it is. and, if SB-Y is greater than (B - Y)th, the 
predetermined value BGO is added to BGAIN in step 
661 . In step 662, x7, y7, x8 and y8 are obtained from 
the vertical and horizontal frame sizes a and b and the 
horizontal and vertical frame positions j and i so as to 
obtain the next position of the AWB frame, and the AE 
control operation is tenminated in step 663. The 
values of n, m, a and b in Fig. 18 may be the same as 
or different from those in Fig. 14. Fig. 20 illustrates an 
AWB frame. In the drawing, the outer frame repre- 
sents the image plane, which is divided into n sections 
in the horizontal direction and m sections in the verti- 
cal direction, the current position of the AWB frame in 
the screen being indicated by i and j. 

As described above, the present invention pro- 
vides an image sensing apparatus comprising: signal 
processing means for processing image sensing sig- 
nals; a plurality of adjustment signal generating 
means for generating mutually different signals for 
automatic adjustment by using part of the signals of 
the signal processing means; interface means for 
inputting the output of the plurality of adjustment sig- 
nal generating means and outputting it through a com- 
mon signal path; and control means for adjusting a 
plurality of adjusting sections of the Image sensing 
apparatus by using the output of the adjustment signal 
generating means. Due to this construction, it is only 
necessary for the microprocessor to receive proces- 
sed data when perfomning automatic focusing, auto- 
malic exposure adjustment, automatic white balance 
adjustment or the like. Accordingly, it is possible to 
adopt an inexpensive microprocessor having rela- 
tively limited processing capability. Further, since the 
processing op ration can be t rminat d within the 
vertical interval, the control sp ed can be increased. 
Furthermore, in the case wher an integrat d-circuit 
construction is adopt d, the number of circuits for 
conn ction with the microprocessor is small, so that 



the mounting ar a can be made very small, thereby 
making it possible to realize the imag sensing 
apparatus in a small size. Further, sine no high- 
speed data is taken out of th integrated circuit, it is 
5 possible to minimize the radiation noise, the power 
noise due to capacity load and the like, thereby con- 
tributing to improvement In sensitivity. 



10 Claims 

1. An image sensing apparatus comprising: 

signal processing means for processing 

image sensing signals; 
15 a plurality of adjustment signal generating 

means for generating mutually different signals 

for automatic adjustment by using part of signals 

of said signal processing means; 

interface means for inputting an output of 
20 said plurality of adjustment signal generating 

means and outputting it through a common signal 

path; and 

control means for adjusting a plurality of 
adjusting sections of said image sensing 
25 apparatus by using the output of said plurality of 
adjustment signal generating means output 
through said common signal path. 

2. An image sensing apparatus according to Claim 
30 1. wherein said signal processing means, said 

adjustment signal generating means and said 
interface means are integrated on a common 
semiconductor. 

35 3. An image sensing apparatus according to Claim 
1, wherein said adjustment signal generating 
means generates signals for automatic focusing. 

4. An image sensing apparatus according to Claim 
40 1. wherein said adjustment signal generating 

means generates signals for automatic exposure 
adjustment. 

5. An image sensing apparatus according to Claim 
45 1, wherein said adjustment signal generating 

means generates signals for automatic white 
balance adjustment. 

6. An image sensing apparatus comprising: 

50 signal processing means for processing 

image sensing signals; 

a plurality of adjustment signal generating 
means for generating mutually different signals 
for automatic adjustm nt by using part of signals 
55 of said signal processing means; and 

interface means for inputting an output of 
said plurality of adjustment signal generating 
means and outputting it through a common signal 



9 



17 



EP 0 501 723 A2 



18 



path. 

said signal processing means, said adjust- 
ment signal generating m ans and said int rface 
means being integrat d on a common semicon- 
ductor. 

7. An image sensing apparatus according to Claim 

6, wherein said adjustment signal generating 
means covers at least one of the following oper- 
ations: automatic focusing, automatic iris adjust- 
ment and automatic white balance adjustment 

8. An image sensing apparatus according to Claim 

7, wherein said interface means converts signals 
of said adjustment signal generating means to a 
common arithmetic-processing form. 

9. An image sensing apparatus according to Claim 

8, wherein said automatic focusing, said automa- 
tic iris adjustment and said automatic white 
balance adjustment are executed serially. 

10. An image sensing apparatus comprising: 

(A) image sensing means; 

(B) extraction means for extracting predeter- 
mined signal components from image sensing 
signals output from said image sensing 
means to obtain a plurality of parameters for 
controlling an image sensing operation; and 

(C) arithmetic processing means for comput- 
ing control values on the basis of the plurality 
of parameters output from said extraction 
means; and 

(D) interface means comprising preproces- 
sing means adapted to convert said plurality 
of parameters to a form allowing arithmetic 
processing by said arithmetic processing 
means and mounted on a common integrated 
circuit. 

11. An image sensing apparatus according to Claim 
10, wherein said plurality of parameters are par- 
ameters for perfonming automatic focusing, auto- 
matic iris adjustment and automatic white 
balance adjustment 

12. An image sensing apparatus according to Claim 
10, wherein said extraction means and said inter- 
face means are mounted on said common inte- 
grated circuit 

13. An image sensing apparatus according to Claim 
10, wherein said interface means supplies an out- 
put from said pr processing means to said 
arithmetic processing means by m ans of a com- 
mon bus. 

14. An image s nsing apparatus according to Claim 



1 0, wherein said interface means supplies an out- 
put from said preprocessing m ans to said 
arithmetic proc ssing means within a vertical 
interval of said image s nsing signals. 

5 

15. An image sensing apparatus according to Claim 
14, wherein said arithmetic processing means 
terminates the arithmetic processing of control 
values within a vertical interval on the basis of 

10 output signals supplied from said interface 
means. 

16. A signal processing circuit for video cameras, 
comprising: 

15 (A) an extraction circuit for extracting a 

plurality of control parameters from image 
sensing signals output from image sensing 
means; 

(B) a data conversion circuit for converang 
20 saidplurality of control parameters extracted 

by said extraction circuit to predetermined sig- 
nal fomns; and 

(C) an output circuit for outputting an output 
from said data conversion circuit to a common 

25 bus. 

17. A signal processing circuit according to Claim 16, 
further comprising a common arithmetic proces- 
sing circuit for performing arithmetic processing 

30 serially on data output from said output circuit to 
generate control values corresponding to said 
control parameters. 

18. A signal processing circuit according to Claim 17, 
35 further comprising an adjustment circuit for 

adjusting an image sensing operation in accord- 
ance with output control values of said arithmetic 
processing circuit 

40 19. A signal processing circuit according to Claim 18, 
wherein said adjustment circuit covers automatic 
focusing, automatic iris adjustment and automatic 
white balance adjustment. 

45 20. A signal processing circuit according to Claim 1 6, 
wherein said extraction circuit, said data conver- 
sion circuit and said output circuit are mounted on 
a common semiconductor integrated circuit. 

50 21. A camera control circuit comprising image sens- 
ing anrangements and camera control devices, an 
integrated signal processing circuit, and a rela- 
tively low speed microprocessor, microcomputer 
or microcontroller unit coupled to the signal pre- 
ss cessing circuit. 

22. A camera control unit comprising a high spe d 
signal proc ssorandalowspe dmicroproc ssor 
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coupled to the signal processor, the signal pro- 
c ssor perfonming th Imag processing and 
camera adjustment calculations and th microp- 
rocessor effecting relativ ly low speed control. 

5 

23. A digital signal processing circuit interface for 
video cameras, the interface being arranged to 
perform image processing and camera adjust- 
ment calculations, and to interface with a control 
unit. 10 
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